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ABSTRACT 

Several  empirical  studies  have  shown  that 
median  filtering  can  be  an  effective  nonlinear 
signal  processing  technique  which  is  sometimes 
superior  to  linear  signal  processing.  In  this 
paper  some  statistical  properties  of  median  fil¬ 
ters  are  analyzed.  In  particular,  results  are 
presented  on  the  noise  suppression  performance 
of  median  filters. 

I.  INTRODUCTION 

Historically,  there  have  been  numerous  devel¬ 
opments  concerned  with  the  linear  filtering  of 
random  sequences.  However,  in  many  cases  if  we 
restrict  our  processing  of  a  random  sequence  to  be 
linear,  then  the  resultant  performance  is  not  ade¬ 
quate.  Thus  in  some  situations  we  are  led  to  con¬ 
sider  nonlinear  schemes  for  processing  data.  In 
several  applications  of  discrete  time  signal  pro¬ 
cessing,  a  nonlinear  scheme  called  median  filter¬ 
ing  has  achieved  some  very  interesting  results. 

The  implementation  of  a  median  filter  requires  a 
very  simple  nonlinear  operation.  Consider  a 
fixed  nonnegative  integer  N.  At  a  given  time  in¬ 
stant,  the  output  of  the  median  filter  is  the  em¬ 
pirical  median  of  the  samples  lying  within  a  win¬ 
dow  centered  at  the  given  time  instant  and  span¬ 
ning  2N+1  adjacent  samples. 

Tukey  [1]  is  generally  credited  with  intro¬ 
ducing  the  concept  of  median  filters,  and  he  did 
much  of  the  pioneering  work  in  this  area  [2-5]. 

This  idea  immediately  triggered  the  use  of  more 
sophisticated  schemes  using  recursively  or  itera¬ 
tively  the  sample  medians  and  combining  the  median 
operation  with  some  linear  processing  of  the  input. 
Some  of  these  modified  median  filters  are  briefly 
described  by  Mallows  [6]  and  are  also  considered 
by  Velleman  [7]. 

Although  the  concept  of  median  filters  was 
first  introduced  in  the  statistics  literature,  it 
soon  found  applications  in  the  area  of  signal  pro¬ 
cessing.  Loosely  speaking,  linear  filtering  tends 
to  smooth  out  abrupt  changes  in  a  sequence  of  data, 
but  a  median  filter  is  capable  of  preserving  sharp 
changes  in  data.  A  review  of  median  filters  as 
well  as  several  algorithms  for  their  real-time  im¬ 
plementation  is  presented  in  [8]  and  [9],  and  some 
applications  of  median  filters  are  presented  in 
[10-14],  A  deterministic  analysis  of  the  process 
of  median  filtering  is  presented  in  [15].  The 
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second  moment  properties  of  the  output  of  a  median 
filter  with  an  independent  identically  distributed 
input  sequence  are  considered  in  [16];  and  in  [17] 
second  moment  properties  of  a  median  filtered  Mar¬ 
kov  chain  are  considered.  In  [18]  a  comparative 
study  of  median  filters  and  Hanning  filters  in 
their  removal  of  Gaussian  and  impulsive  noise  from 
a  constant  signal  is  presented. 

In  this  paper  we  will  consider  both  the 
median  filter  as  described  above  and  also  a  slight 
modification  of  it.  These  will  be  defined  in  the 
next  section.  Then  we  will  analyze  the  effect  of 
a  median  filter  on  an  input  which  consists  of  the 
sum  of  a  known  constant  signal  and  independent 
identically  distributed  noise.  Specifically,  we 
will  study  the  probability  that  the  difference 
between  the  output  of  the  filter  and  the  constant 
signal  is  close  to  zero.  This  probability  can  be 
used  to  determine  the  performance  of  the  filter 
on  a  per-sample  basis.  Some  examples  are  presen¬ 
ted  to  illustrate  the  results. 

II.  PRELIMINARIES 

Consider  a  discrete  time  random  process 
{Xn,  n=0,+l ,+2, . . .;  which  will  denote  the  input  to 

the  median  filter.  The  random  process  'Y^,  n=0, 

+l,+2,...l  will  denote  the  output.  Let  W  be  a 
positive  integer.  If  W  is  an  odd  integer,  say 
W  =  2N+1,  then 

Yj  =  med' Xj-N’  Xj-N+1 ’ ' ' ‘ ,Xj+N^ ’ 

where  med { • }  denotes  the  empirical  median.  If  W 
is  an  even  integer,  say  W  =  2N,  then  we  will  de¬ 
fine  the  output  Yj  of  the  (modified)  median  filter 

to  be  the  arithmetic  mean  of  the  N-th  and  (N+l)-st 
smallest  samples  in  the  set  fXj_N+^,  Xj^^,..., 

Xj+N) .  That  is,  when  W  is  even,  Y ^  is  the  average 

of  the  two  central  order  statistics  of  the  samples 
in  the  window  spanning  the  W  adjacent  samples 
starting  at  the  (j-W/2+l)-st  sample.  In  general, 
the  integer  W  will  be  called  the  window  size  of 
the  median  filter.  The  sequence  fY,1  obtained  by 
positioning  the  window  and  selecting  the  appropri¬ 
ate  output  value  is  the  output  of  the  median  fil¬ 
ter.  It  is  clear  that,  in  general,  the  median 
filter  is  a  nonlinear  scheme.  The  only  exceptions, 
in  which  the  filter  is  linear,  are  when  W=1  and 
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W=2.  A  median  filter  with  an  odd  window  size  will 
be  called  an  odd  span  median  filter  (OMF)  and  one 
with  an  even  window  size  will  be  called  an  even 
span  median  filter  (EMF).  Both  OMF's  and  EMF's  in¬ 
volve  a  ranking  procedure,  but  EMF's  also  involve 
an  additional  averaging. 

A  study  of  the  dependency  introduced  by  OMF's 
when  the  input  is  a  sequence  of  independent  iden¬ 
tically  distributed  random  variables  or  a  homogene¬ 
ous  Markov  chain  is  presented  in  [16]  and  [17], 
respectively.  Illustrative  examples  in  these 
cases  suggest  that  OMF's  display  a  typical  "low 
pass"  characteristic  with  large  window  sizes  hav¬ 
ing  narrower  "pass  bands"  than  OMF's  with  small 
window  spans. 

In  the  sequel  we  will  model  the  input  as  a 
known  constant  signal  with  additive  independent 
identically  distributed  noise.  That  is,  let  Xn  = 

a  +  Zn>  where  {Z^}  is  a  sequence  of  independent 

identically  distributed  random  variables.  Denote 
the  common  univariate  distribution  function  of  the 
noise  by  F.  We  will  assume  that  the  noise  posses¬ 
ses  a  density  function,  denoted  by  f{x)  =  dF(x)/dx. 
In  order  to  evaluate  the  noise  removal  properties 
of  median  filters,  we  will  be  interested  in  deter¬ 
mining  P(jYn-aj  <_  e  ) .  Without  loss  of  generality, 

we  will  simplify  notation  by  assuming  that  a=0. 

That  is,  if  an  input  ln  is  transformed  by  a  median 

filter  to  the  output  Z^  and  if  a  is  a  constant, 
then  the  input  Zn+a  will  be  transformed  by  the 
median  filter  to  2n+a.  Thus  if  the  input  is  a  con¬ 
stant  signal  plus  noise,  then  the  output  minus  the 
constant  signal  is  simply  what  the  output  would  be 
if  the  input  had  consisted  of  noise  alone. 

III.  ODD  SPAN  MEDIAN  FILTERS 


Let  W  =  2N+1 .  Then 

Yj  =  med{Xj_N,  Xj_N+1»---.  Xj+N) . 

Since  the  input  sequence  f Xn>  is  independent  and 

identically  distributed,  we  see  that  the  output 
{ Yj}  is  identically  distributed  (but  not  indepen¬ 
dent).  We  recall  that  the  density  function  of  Y j , 
say  fy,  is  given  by  [19,  p.9] 

fY{y)  =  f(y)[F(y)]N[l-F(y)]N.  (1) 

Y  (n:)z 


Thus  we  see  that  for  a  given  W  =  2N+1  and  a  given 
c  >  0,  P(|Yj|  <_  c )  depends  only  upon  the  values  of 

F(e  )  and  F(-e).  For  example,  let  c  be  a  positive 
number  less  than  one.  Let  q^e)  =  P  (|Yj|  c  ) 

when  XR  is  uniformly  distributed  on  [-1,1].  For  c 

positive,  let  q2(e)  *  P ( [  Y ^ |  <_  e  )  when  Xn  has  a 

Laplace  distribution  with  zero  mean  and  unit  vari¬ 
ance,  and  let  q3(c)  =  P(|Yj|  <.  e )  when  Xn  has  a 

Gaussian  distribution  with  zero  mean  and  unit  var¬ 
iance.  Then  a  straightforward  calculation  shows 
that 


q-|  (e  )  =  q2  [-  Y  nn(l-e  )] 


where  4>  ( x ) 


i  <-*  2„ 

-L  /  e"u  12  du. 
/2*  -• 


The  expression  in  (3)  furnishes  a  convenient 
method  for  calculating  the  probability  of  error 
associated  with  a  median  filter.  For  example,  if 
(Xn)  is  a  sequence  of  independent  zero  mean  unit 

variance  Gaussian  random  variables,  then  for  a 
median  filter  with  window  size  W=3,  P  ( |  Y  ^  [  <_  0.1) 

~  0.119,  and  for  a  median  filter  with  window  size 
W=5,  P( | Yj ]  <  0.1)  =  0.149,  while  P(|Xn|  <  0.1)  - 

0.096. 

A  plot  of  P ( J Y j |  <^e)  versus  F(e)  is  given  in 

Fig.  1  for  symmetric  noise  densities  and  different 
window  sizes. 

Consider  for  the  moment  a  one  sided  noise 
density,  i.e.  f(x)=0  for  x  <  0.  Then  (3)  reduces 
to 


2N+l-i 


We  are  Interested  in 

p(  I  Yj  |  <  e)  (2) 

for  e  >  0.  Using  the  binomial  expansion  and  a 
change  of  variable,  we  can  see  that  substitution 
of  (1)  into  (2)  yields 


If  we  realize  that  in  this  case,  P( ! Y j |  <_c)  is 

simply  the  probability  that  at  least  N+l  samples 
within  the  window  are  no  greater  than  c,  we  see 
that  the  above  expression  can  be  re-written  to 
give 

P(  1  Yj |  <  c)  =  ^  (2Nifl)[F(c)]i[l-F(e)]2N+1*i 


3 


when  f(x)=0  for  x  <  0.  A  straightforward  calcula¬ 
tion  yields  that  for  a  median  filter  with  window 
size  W=3  if  F(0)=0  and  F(r)  =  0.1,  then  P{|  Y^l  <_  e ) 

=  0.028;  while  if  W=5,  we  have  P(!  <_  c  )  = 

0.00856.  However,  in  these  cases  the  median  filter 
did  not  help,  since  P ( |  Xnl  <_  e  )  =0.1. 

IV.  EVEN  SPAN  MEDIAN  FILTERS 


In  the  previous  section  it  was  necessary  for 
the  value  of  one  of  the  input  samples  from  within 
the  window  to  lie  within  the  interval  [-e,e]  in 
order  for  the  event  (|  V\|  <  c )  to  occur.  In  the 

case  of  an  EMF  the  event  (|Yj|  <_e)  could  occur 

even  if  none  of  the  input  samples  lie  within  the 
interval  [-e,e].  As  described  previously,  for  an 
EMF  the  event  (i  Y. |  le)  is  equivalent  to  the  sit¬ 
uation  that,  after  ranking  the  W=2N  samples,  the 
arithmetric  mean  of  the  two  central  order  statis¬ 
tics  has  a  magnitude  no  greater  than  c.  To  cal¬ 
culate  the  probability  of  this  event,  we  will  use 
the  bivariate  density  function  of  the  two  central 
order  statistics,  and  we  will  then  do  a  transfor¬ 
mation  to  obtain  the  density  function  of  the  out¬ 
put  of  the  EMF. 

Let  W=2N  be  the  window  size,  and  let  S1  and 

S,,  be  the  two  central  order  statistics.  That  is, 

of  the  2N  samples  in  the  window,  S^  is  the  N-th 

and  S?  is  the  (N+l)-st  in  increasing  order.  Then 

the  bivariate  density  of  S,  and  S,  is  given  by 
[19,  p.  10]  If 


fSrS2(sl’s2)  = 


(2N)1 

[(N-l):]2 


f(s1)f(s2)  • 


Upon  integrating  fc(s)  over  [-c  «e  ] ,  we  obtain 
P(!  Yj]  <e).  S 

V.  EXAMPLE 


Consider  zero  mean  unit  variance  noise  with 
the  Laplace  distribution  function 


F  ( x ) 


1  /7x 

7  e 


x  <  0 


^[2-e*/?x],  x  >  0  . 


The  performance  of  a  median  filter  for  this  input 
distribution  was  calculated  according  to  the  devel¬ 
opments  of  Sections  III  and  IV.  For  e  >  0  and  w 
odd  (W=2N+1 )  we  have 


(2_e-/2c)2N+l-i  e-/2c(2N-H-i) 

(2N+l-i)22*i7rr:i 

For  c  >  0  and  W  even  (W=2N)  we  have 
PtlYjl  Ie)  =  l-2Fs(-r), 

where 

F$(-e )  =  J  fs(s)ds 

and 


[F(s1)]N-,[1-F(s2)]N“1 


S  (n:)2  ?ZN  Z 


■  2s 


/  exp[2N'T(y-s)]dy 


for  s1  I  s2,  and  it  is  zero  for  s^  >  S2-  Define 
the  random  variable  S  by 

S  -  \  (s1  +  s2). 


Then  the  bivariate  density  of  S1  and  S  is 
straightforwardly  found  to  be 


V(srs)= 


2N2(2N): 

Tn:)2 


f(s1)f(2s-s])  • 


•  [F(s1)]N-1[1-F(2s-s1)]N'1 
when  s  >  s1 ,  and  it  is  zero  when  s  < 

Thus  we  see  that  the  density  function  of  the  out¬ 
put  of  the  EMF  is  given  by 


F<j(s)  = 


2N2(2N): 

(n:)2 


/ 


Sf(x)f(2s-x)  . 


oo 


•  [F(x)]""1[l-F(Zs-x)l"“1dx. 


+  /  exp[,'2(y[N-l]-2s)]-[2-exp(->'2(y+2s))]N  'dy 
2s 

for  s  <  0. 

Fig.  2  indicates  the  performance  characteris¬ 
tics  of  median  filters  with  window  sizes  W=l,2,3, 
4,5  when  the  input  is  independent  witn  a  zero  mean 
unit  variance  Laplace  distribution. 

VI.  COMMENTS 


Recall  that  a  median  of  a  random  variable  X 
is  any  number  m  such  that 

P(X  >  m)  >£<  P(X  <  m). 

Thus  a  random  variable  either  has  a  unique  median, 
or  else  it  has  medians  for  all  points  of  a  closed 
interval  [20,  p.  256].  Assume  for  the  moment  that 
the  distribution  function  F,  the  common  distribu¬ 
tion  function  of  the  input  sequence  of  Independent 
random  variables,  admits  a  unique  median  m.  Then 


it  follows  in  a  straightforward  fashion  from  the 
Glivenko-Cantelli  theorem  [21,  p.  261]  that  as  the 
window  size  W  approaches  infinity,  the  output  of 
the  median  filter  converges  to  m  with  probability 
one.  Thus  if  Xn  2  0  with  probability  one  and  if 

c  <  m,  then  it  is  easily  seen  that  p(lfj!  £  e) 

should  converge  to  zero  as  W  approaches  infinity. 
This  observation  is  consistent  with  the  phenomenon 
exhibited  in  the  example  at  the  end  of  Section  III. 
Conversely,  for  a  zero  mean  Gaussian  or  Laplace  in¬ 
put,  we  would  expect  that  for  any  positive  c, 

P(  |Y.  [  _<  e)  should  converge  to  one  as  W  approaches 

infinity;  and  this  observation  is  consistent  with 
the  examples  we  have  exhibited. 

In  conclusion,  we  have  considered  the  noise 
suppression  performance  of  median  filters  when  the 
input  consists  of  a  constant  signal  plus  indepen¬ 
dent  identically  distributed  noise.  The  results 
presented  in  this  paper  enable  one  to  determine 
the  performance  of  a  median  filter  on  a  per-sample 
basis.  Several  examples  were  presented  to  illus¬ 
trate  the  results;  and  it  was  seen  that  in  some 
cases  median  filters  did  provide  noise  suppression, 
while  in  other  cases  (e.g.  one  sided  noises)  they 
did  not  help.  Further  investigations  of  the  noise 
suppression  performance  of  median  filters  for  non¬ 
constant  signals  in  dependent  noise  would  be  use¬ 
ful  . 
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